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Abstract. Second-order necessary conditions for optimal control problems are considered, where 
the "second-order" is in the sense of that Pontryagin's maximum principle is viewed as a first-order 
necessary optimality condition. A sufficient condition for a local minimizer is also given. 
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1. Introduction. We will give a new kind of second-order necessary/sufficient conditions 
for optimal controls. Second-order necessary /sufficient conditions for optimal control problems 
have been studied for a long time. There are many relevant works. Among them, we mention 
the following works and the references therein: [1] — [8], [11] — [15], [18] — [30] and [32]. There 
are different definitions of "first-order necessary/sufficient conditions" and "second-order nec- 
essary/sufficient conditions". To our best knowledge, the corresponding first-order necessary 
conditions to these second-order conditions in the literature are not Pontryagin's maximum prin- 
ciple. In addition, the control domains considered there arc domains (or closed domains) in R m . 
In other words, second-order necessary/sufficient conditions for optimal controls in the literature 
are mainly used to distinguish optimal controls from other singular controls in the classical sense, 
not from other singular controls in the sense of Pontryagin's maximum principle. For the defini- 
tions of singular controls in the classical sense and singular controls in the sense of Pontryagin's 
maximum principle, see Definitions 1 and 2 in [11], see also (4.5) and (4.3). 

Before we focus on our problems, we recall the results about necessary conditions for mini- 
mizers of functions. 
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Let us consider a minimizer xo of a smooth function /(•) on Q, where f2 is the closure of a 
domain ft C R™ . We call a unit vector £ is an admissible direction if there exists a S > such 
that £o + s ^ € for any s e [0, 5]. If ^ is admissible, we have the following first-order necessary 
condition: 

< lim /(*° + «*)-/(*") = { Vf(x ),l) . (1.1) 

When 

(V/(.t M)=0 (1.2) 
holds, i.e., (1.1) degenerates, then we can get further the second-order necessary condition: 

< s lim + = \ (D 2 f{x Q )l,l) , (1.3) 

where D 2 f is the Hessian matrix of /. If (1.2) does not hold, that is 

(wf(x ),e) > o, 

then (1.3) does not necessarily hold . 

From the above observations, we see that to yield second-order conditions of a minimizer, 
linear structure of independent variables is needed and second-order conditions only appear when 
first-order conditions degenerate. 

For an optimal control problem, usually the control domain U need not have linear structure. 
Thus, the space U a d of control functions need not have linear structure. Pontryagin's maximum 
principle is a kind of necessary conditions that a minimizer satisfies. Many people look it as the 
first-order necessary condition. However, Pontryagin's maximum principle could not be obtained 
directly in a way like (1.2). First, for an optimal control u(-), there is probably no "admissible 
direction" v(-) such that u(-) + sv(-) is still in U a d- Secondly, even if "admissible direction «(•)" 
exists, what we could get from 

Q ^ Um J{u{-)+ S v{-))-J{u{-)) 

s^0+ s 

is only a corollary of Pontryagin's maximum principle which looks like (4.4), where we denote 
J(-) the cost functional of the optimal control problem. 

When linear structure lacks, could we replace the "admissible direction" by "admissible path"? 
In other words, could we replace u(-) + sv(-) by u s (-) G hi a d, which is continuous in some sense in 
s € [0, 1]? Certainly, we can do that. Yet, "admissible path" will immediately puzzles us on what 
are first-order conditions and second-order conditions. To see this, let us consider the function 
/(•) and its minimizer xq again. Let I be an admissible direction such that (1.2) holds. Then 
choosing x(s) = xq + \fsi, we have 

< Jim /(X0) = \ (D 2 f(x )t, i) . (1.4) 
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Then, should we call (1.4) a first-order condition? Therefore, we think it is not a good idea to 
replace "admissible direction" by "admissible path" . In this paper, we will transform the original 
optimal control problem to a new problem, which is in fact the locally relaxed problem of the 
original problem. In this new problem, the corresponding space of control functions has linear 
structure and we can yield Pontryagin's maximum principle like (1.1) under this linear structure. 
Then we can further yield second-order conditions based on Pontryagin's maximum principle. 

To reveal our idea clearly, we consider simply optimal control problems governed by ordinary 
differential equations. 

The rest of the paper is organized as follows: In Section 2, we will give a method to linearize 
the control space near the optimal control. In Section 3, We will give a new proof of Pontryagin's 
maximum principle. Section 4 will be devoted to second-order necessary conditions of optimality. 
Finally, a sufficient condition for a control being a local minimizer will be given in Section 5. 

2. Local Linearization of Optimal Control Problems. In this section, we will linearize 
locally an optimal control problem along its minimizer. Let us consider the following controlled 
system: 

' x(t) = f(t,x(t),u(t)), in [0,T], 
ie(0) = x 

and the following cost functional 

i-T 



(2-1) 



J{u(-))= f f°(t,x(t),u(t))dt, (2.2) 
Jo 

where T > 0, and tt(-) € U a d with 

U ad = {v : [0, T] -> U\ v(-) measurable } . (2.3) 

We pose the following assumptions: 

(SI) The metric space (U, p) is separable. 

<S2) — ' " ( / ) " ^ f f [0,T] X R" x £7 -t R n+1 are 

measurable in t, continuous in (x, u) and continuously differentiable in x, where B T denotes the 
transposition of a matrix B. Moreover, there exists a constant L > such that 

\{(t,x,u) — f (t, x,u)\ < L\x — x I, 

11 ' ' V (t, x, x, u) e [0, T] x R n x R™ x U. (2.4) 

|f(t,0,u)| <L, 

Now, let u(-) € Uad be a minimizer of J(-) over U a d- We linearize U a d along u{-) in the 
following manner. Define 

M„ d = {(l-a)5 a( .) +«<*„(.) |ae [0, l],u(-) e U ad ) , (2.5) 
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where 5 V denotes the Dirac measure at v on U. For an element cr(-) = (1 — a)S u ^+a5 u ^ G M a d, 
denote 



f (t, x, a(t)) = / {(t,x,v)a(t)(dv) = (1 - a)i(t,x,u(t)) + af(t,x,u(i)). 
Ju 

Then we can define x(-) — x(-;a(-)) as the solution of the equation 



x(t) = f(t,x(t),a(t)), in [0,T], 
x(O) = .T 



(2.6) 



(2.7) 



and the corresponding cost functional J {&{■)) by 



J(a(-))= f f(t,x(t;a(-)),a(t)) 
Jo 



dt. 



(2.8) 



We can see that x(-; u(-)) and J(u(-)) coincide with x(-: 5 u r.\) and J(5 u r.\) respectively. Thus, U a d 
can be viewed as a subset of M. a d in the sense of identifying u(-) G hi a d to <5„(.) € M. a d- Readers 
who are familiar with relaxed controls will immediately find M. a d is a subset of relaxed control 
space. Yet, elements of M. a d are much simpler than other relaxed controls. This is why we need 
neither to pose additional assumptions like that the control domain is compact as Warga did 
(c.f. [31]) nor to introduce the relaxed control defined by finite-additive probability measure as 
Fattorini did (c.f. [9]). M. a d has a linear structure at u(-), i.e., it contains all elements in the 
form Su(-) + a {3u( : ) ~ $u(-)) ( a € [0, 1]). It can be proved easily that $u(-) 1S a minimizer of J(<r(-)) 
over Ai a d- Using this fact, we can derive Pontryagin's maximum principle from 

_ a^0+ a 

It is easy to prove the following results. 



Lemma 2.1. Let (SI) — (S2) hold. Then, there exists a constant C > 0, such that for 

O-(-) € M ad , 

' \\x(-,a(-))\\ c[ o,T]<C, 

\x(t;a(-))-x(i;a(-))\ < C\t - i\. 

Proof. Let er(-) e M a d and x(-) — x(t;a(-)). We have 

x(t)=x + [ f(s,x(s),a(s))ds, Vte[0,T]. 
Jo 

Then it follows from (S2) that 



(2.10) 



\x(t)\ < \x \ + 



Jo 



(s)) ds 



L 



\x(s)\ ds 



< \x \+LT + l[ \x(s)\ds, Vie[0,T]. 
Jo 
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Thus, by Gronwall's inequality, 

\x(t)\ < (\x Q \+LT)e Lt , Vie[0,T]. 

Consequently, by (S2), 

\f{t,x(t),a(t))\ <L + L\x(t)\ < L + L{\x \ + LT)e LT , Vi G [0,T]. 

Therefore 



(2.11) 



\x(t)-x(i)\ 



f(s,x(s),a(s)) ds 



< L(l + (\x \ + LT)e LT ^ \t-i\,Vt,t£ [0,T]. (2.12) 



We get (2.10) from (2.11)— (2.12). 



□ 



u a > £ (t) 



Lemma 2.2. Let (SI) — (S2) hold and u(-) be a minimizer of J(u(-)) overU a d- Then <5 fi (.) is a 
minimizer of J(cr(-)) over M a d- 

Proof. Fix a e [0, 1] and u(-) € U a d- Denote <J a {-) = (1 — a)b~ U (-)+ a b'u(-) and x a (-) = x(-;a a (-)). 
We will prove that 

J(S U{ .)) < J(cr a (-))- (2.13) 

For e > 0, define 

' u(t), if {f} e [0,a), 
u(t), if {f} e M), 

where {a} denotes the decimal part of a real number a. Then ti a ' £ () S U a d- Denote x a ' £ (-) = 
x(-;u a - £ (-)). Then by Lemma 2.1, x a ' £ (-) is uniformly bounded and equicontinuous on [0,T]. 
Consequently, by Arzela-Ascoli's theorem, along a subsequence e — > + , x a ' £ (-) converges uni- 
formly to some y(-) in [0,T]. Thus, using a generalization of Riemann-Lebesgue's Theorem (see 
Ch. II, Theorem 4.15 in [33]), we can easily prove that by a subsequence e — > + , 

f(t,y(t),u a > £ (t)) -> f(t,y(t),a a (t)), weakly in L 2 (0,T;1R"). (2.14) 

Since 

\f(t,x a > £ (t),u a > £ (t)) - f(t,y(t),u a > £ (t))\ <L\x a > £ (t) - y(t)\ , 
it follows from (2.14) that 

f(t,x a ' £ (t),u a > £ (t))-+ f(t,y(t),a a (t)), weakly in L 2 (0,T;IR"). (2.15) 

Similarly, 

f(t,x a - £ (t),u a ' £ (t))^ f°(t,y(t),a a (t)), weakly in L 2 (0,T). (2.16) 
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Passing to the limit for e — > + in the following equality 

x a ' £ (t)=x + f f(s,x a > e (s),u a > E (s))ds, 
Jo 

we get from (2.15) that 

y(t)=x + f(s,y(s),a a (s))ds, 
Jo 

i.e., y(-) — x a {-). Furthermore, we can see that x a ' £ (-) itself converges uniformly to x a (-) in 
[0,T]. Combining this with (2.16), we have 

J(%)) < £ lim J(u^(.)) = JK(-)). (2.17) 

□ 



3. Pontryagin's Maximum Principle. Now, we will derive Pontryagin's maximum prin- 
ciple from (2.9). The idea of our proof could be tracked back to the works on relaxed control 
(c.f. [10] and [31], for example). However, one can still find that the proof we will give later has 
some improvement. Moreover, it can also be used to problems governed by partial differential 
equations and even having state constraints (c.f. [17]). 

We keep the notations used in §2 and denote x(-) = x(-; &(■)). We have 

x a (t)-x(t) _ [* rf(s,x a (s),u(s))- f(s,x(s),u(s)) 



X a (t) 



a 



+f(s,x a (s),u(s)) ~ f( S ,x a (s),u(s)) 



ds 



f x (s,x(s) + r(x a (s) - x( S )),u(s)) T drX a (s) 



+f(s,x a (s),u(s)) - f(s,x a (s),u(s)) 



ds. 



(3.1) 



where f x (t, x, u) denotes the transpose of the Jacobi matrix of / on x. By (3.1), (S2), and using 
the same argument as the proof of the uniform convergence of x a (-) — > x(-) in [0,T], we can 
easily get 

X a (-) -> X(-), uniformly in [0,T] 



and X(-) solves the variational equation 

X(t) = f x (t,x(t),u(t)) T X(t) + f(t,x(t),u(t)) - f(t,x(t),u(t)), in [0,T], 
X(0) = 0. 

Now, by introducing the adjoint equation 

1p{t) = -f4t,x{t),u{t))^(t) + f°{t,x{t), «(*)), in [0,71, 

m = 0, 



(3.2) 



(3.3) 



(3.4) 
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we get from (2.17) and Lebesgue's dominated convergence theorem that 
J((l - ct)6 U (.) + ad u( . } ) - J(<5 fi( .)) 



< lim 
= lim 



f 

Jo 



f°(t,x a (t),u(t))-f°(t,x(t),u(t)) 



a 

pOn „,ai 



dt 



+f(t,x a (t),u(t))-f(t,x a (t),u(t)) 
= lim f f f 1 (f°(t,x(t) + s(x a (t) - x(t)),u(t)),X a (t)) ds 

«^0+ J LJ 



dt 



+f(t,x a (t),u(t))-f(t,x a (t),u(t)) 

= [ \(f At,x(t),u(t)),X(t))+f(t,x(t),u(t))-f°(t,x(t),u(t)) 
Jo 1 



dt 



f \H(t, x(t),u{t)), 1>{t)) - H(t, x(t),u{t)), i>{t)) 
Jo L 



dt, 



(3.5) 



where 

H(t, x, u, i>) = (f(t, x, u), i>) - f°(t, x, u), V {t, x, u, i>) e[0,r]xE"xt/xR" (3.6) 

Then, since U is separable and H is continuous in u, it follows from (3.5) and a standard argument 
that 

H(t,x(t),u(t)),i>(t)) = max.H(t,x(t),v,^(t)), a.e.te[0,T]. (3.7) 
Relations (3.4), (3.6), (3.7) form Pontryagin's maximum principle. 



4. Second-Order Necessary Optimality Conditions. We turns to study second-order 
necessary optimality conditions where Pontryagin's maximum principle is viewed as a first-order 
necessary optimality condition. In other words, we will give a second-order necessary condition 
for optimality to distinguish singular controls in the sense of Pontryagin's maximum principle. 
One can see that in (3.7), the equality holds if and only if 

a.e. te[0,T}. (4.1) 



u(t) € U(t) = < w\H(t,x(t),w,ip(t)) = maxH(t,x(t),v,ip(t)) 



In this case, 



f \ </°(t, x(t),u(t)),X(t)) + f°(t, x(t),u(t)) - f°(t, x(t), u(t)) 
Jo L 



dt = 0. 



(4.2) 



Denote 

U ad = {«(■) eU ad \v{t) eU(t), a.e. t e [0,T]}. (4.3) 

Elements in U a d are called singular controls in the sense of Pontryagin's maximum principle. If 
U is an open subset of R m , then 



H u (t, x{t),u(t), i>{t)) = 0, a.e. t e [0, T\. 



(4.4) 
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In this case, we call elements in 

{v{-)eK ad \H u (t,x{t),v(t),^(t))=0, a.e.ie[0,T]} (4.5) 

as singular controls in the classical sense (see Definitions 1 and 2 in [11]). 
Now we make the following assumption: 

(S3) Functions f are twice continuously differentiable in x. Moreover, it holds that 

%{t,x,u)-f x (t,x,u)\<L\x-x\, V (t, x, x, u) € [0, T] x ET x R n x U. (4.6) 
We mention that (S2) implies 

\i x (t,x,u)\ < L, V(t,x,u) e [0,T] x R n x U 

and (S3) implies 

\fL(t,x,u)\ < L, V(t,x,u) G [0,T] x R" x U 

for k = 0, 1, 2, . . . , n. 

The following theorem gives second-order necessary optimality conditions. 

Theorem 4.1. Let (SI) — (S3) hold and u(-) be a minimizer of J(-) overU a d- Define W(-) be 
the solution of the following second-order adjoint equation: 



W{t) + f x (t, x(t), u(t))W(t) + W(t)f x (t, x(t), u(t)) T 

+H xx (t,x(t),u(t),lp(t)) = 0, in [0,T], 

W(T) = 



and $(•) be the solution of 

t(t) = f x (t,x(t),u(t)) T $(t), in [0,T], 
¥(0) = I, 

where I is the unit n x n matrix. Then for any u(-) € U a d, 



(4.7) 



(4.8) 



dt / (W(t)(f(t, x(t),u(t)) - f(t, x(t),u(t))) 
Jo x 

+/7 x (i, i(t), u(t),^(t)) - fl*(t, u(t),^(t)), 
^(^(s)- 1 ^^, *(«),«(*)) - /(*, £(«), u («)))\ < 0. 



(4.9) 



Proof. Let u(-) e f/ ad . Then by (4.2), for any a <= (0, 1], 

J((l - cv)(5 fi( .) + aJ u( .)) - J(5 fi (.)) 

- « A f {f x {t,x(t) + S {x a {t)-x{t)),u(t)),X a (t)) ds 
Jo Jo 
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+f(t,x a (t),u(t))-f(t,x a (t),u(t)) 



dt 



a I dt (f2(t,x(t) + s(x a (t) - i(t)),0(t)) - f° x (t,x(t),u(t)),X a (t)) ds 
Jo Jo 

+a f (f^(t,x(t),u(t)),X a (t)-X(t)) dt 
Jo 

+a [ \(f(t, x a (t), u(t)) - f(t, *(*),«(*))) - (f°(t, x a {t),u{t)) ~ f°(t, x(t), u(t)))} dt 
Jo 1 J 

a 2 [ dt [ ds [ s(f° x (t,x(t) + sr(x a (t) - x(t)),u{t))X a (t),X a (t)) dr 
Jo Jo Jo 

W [ T (f°(t,x(t),u(t)),Y a (t)) dt 
Jo 

W ( dt f (f x {t,x(t) + s{x a (t) -x{t)),u(t)),X a {t)) ds 
Jo Jo 

f dt [ (f x , (t,x{t) + s(x a {t)-x(t)),u(t)),X a (t)) ds, (4.10) 
o Jo 



where Y a {-) = {Yf(-) F 2 Q (-) 



T = x°(.)-x(.) sat . sfies 

a 



Y k a (t) 



(f k (s,x(s)+r(x a (s) - x(s)),u(s)),X<*(s)) dr 



+f(s,x a (s),u(s)) - f k (s,x a (s),u(s)) 



ds 



t r 



{£{8, x(s),u(s)),X(s)) + f k (s, x, u(s)) - f k ( s , x(s), 0(a)) 

= f ds [ dr [\(f k x (s,x(s)+T((x a (s)-x(s)),u(s))X a (s),X a (s)) d( 

Jo Jo Jo 

+ f ds [ (f k (s,x(s) + T(x a (s)-x(s)),u(s)),X a (s)) dr 
Jo Jo 

- I ds [ (f k (s,x(s) + T(x a (s)~x(s)),u(s)),X a (s)) dr 
Jo Jo 
t 

k. 



+ / (/, fe ( S ,5( S ),0( s )),r a ( s )) ds, fc = l,2,...,n. 
Jo 



(4.11) 



Using (S3) and by the same way to derive (3.2), we can get 



Y a (-)^Y(-), uniformly in [0, T] 



(4.12) 
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where Y(-) solves the following second variational equation 

Y(t) = f x (t,x(t),u(t)) T Y(t) + (f x (t,x(t),u(t)) - f x (t,x(t),u(t))) T X(t) 



+ 1 



f(fUt, x(t),u(t))X(t),X(t))\ 
(f xx (t,x(t),u(t))X(t),X(t)) 

\(f- x (t,x(t),u(t))X(t),X(t))J 



, in [0,T], 



(4.13) 



y(o) = o. 

Then it follows from (4.10) and Lebesgue's dominated convergence theorem that 
Q < Um J((l - a)5u(.) + aS u{ .)) - J(Sy.(.)) 

~ a^0+ a 2 

i-T i-T 

(f°(t,x(t),u(t)),Y(t)) dt+ / (f^(t,x(t),u(t)) -f°(t,x(t),u(t)),X(t)) dt 



1 



(f xx {t lX {t)Mi))X{t),X(t)) dt 



= [ (H x (t,x(t),u(t),il)(t))- H x (t,x(t),u(t),^(t)),X(t)) dt 
Jo 

-\f (H xx (t,x(t),u(t)Mt))X(t),X(t)) dt 

= [ (H x (t,x(t),u(t),^(t))~ H x {t,x{t),u(t)^{t)),X(t)) dt 
Jo 

[ H xx (t,x{t),u(t)Mt))X(t)X(t) T dt} 7 
-Jo J 



1 

2 tr 



(4.14) 



where tri? denotes the trace of a matrix B. One can easily verify that 



-(X(t)X(t) T ) = f x (t,x(t),u(t)) T (X(t)X(t) T ) + (X(t)X(t) T )f x (t,x(t),u(t)) 



+(/(*, x(t), u(t)) - f(t, x(t),u(t)))X(t) T 
+X(t)(f(t,x(t),u(tj) - f(t,x(t),u(t))) T , in [0,T], 



(4.15) 



X(0)X{0) T = 0. 



Now, we introduce the second-order adjoint equation (4.7). By (SI) — (S3), we can see that (4.7) 
admits a unique solution W(-). Since W(-) T satisfies (4.7) too, W(-) should be symmetric. Since 
tr (AB) = tr (BA) for all k x j matrix A and j x k matrix B, we have 



1 

-2 tr 
1 

= 2 tr 



H xx {t, x{t), u(t), ip{t))X (t)X (t) T dt 



(j t W (t) + fxtt, x(t), u(t))W(t) + W(t)f x (t, x(t), u(t)) T )x(t)X(t) T dt 



\^{[ \ r w(t)^(x(t)x(t) T ) + f x (t 7 x(t),mW(t)x(t)x(t) T 
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+W(t)f x (t, x(t), u(t)) T X(t)X(t) T ] dt} 

l - tr { J [ - W(t)f x (t, x(t), u(t)) T X(t)X(t) T - W(t)X(t)X(t) T f x (t, x(t),u(t)) 
-W(t)(f(t, x(t), u(t)) - f(t, x(t),u(t)))X(t) T 
-W(t)X(t)(f(t,x(t),u(t)) - f(t,x(t),u(t))) T 

+f x (t, x(t), u(t))W(t)X(t)X(t) T + W(t)f x (t, x(t),u(t)) T X(t)X(t) T ] dt} 

T 

(W(t)(f(t, x(t), u(t)) - f{t, x(t),u(t))), X(t)) dt. (4.16) 



By (3.3) and (4.7), 



X(t) = f mH^Uis, x(s), «(«)) - f(s, x(s),u(s))) ds. 
Jo 



10 

Thus, it follows from (4.14) and (4.16) that 



< / (W(t)(f(t,x(t),u(t))-f(t,x(t),u(t))) 





+H x {t, x{t), u{t)3(t)) - H x (t, x{t),u(t),^{t)),X(t)^ dt 

J dt (W(t)(f(t,x(t),u(t))- f(t,x(t),u(t))) + H x (t,x(t),u(t),m) 
-H x (t, x(t), u^Mt^MtMsy'ifis, x(s),u(s)) - f(s, x(s),u(s)))) ds. 



Therefore, we finish the proof. □ 



To get an analogue of the maximum condition in Pontryagin's maximum principle, we intro- 
duce a lemma concerned with the well-known Filippov's Lemma or measurable selection. We 
recall that a Polish space is a separable completely metrizable topological space. We mention 
that all (nonempty) closed sets and open sets in R m are polish spaces. 

Lemma 4.2. Let X be a Polish space, T C ]R" be a Lebesgue measurable set. Assume that 
r : T — > 2 X is measurable (i.e., for any closed set F, {t G T\T(t) G F} is measurable) and takes 
values on the family of nonempty closed subsets of X . Then T(-) admits a measurable selection, 
i.e., there exists a Lebesgue measurable map 7 : T — )■ X , such that 

j(t)eT(t), &.e.teT{t). 

Lemma 4.2 and its proof can be found in [16] (Ch. 3, Theorem 2.23). Based on this lemma, we 
have that 
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Theorem 4.3. Let U be a Polish space. Then under assumptions of Theorem 4-1, for almost 
all t G [0,T], it holds that: 

W(t)(f(t, x(t), u(t)) - f(t, x(t), v)) + H x (t, x(t), u(t)^(t)) 
-H x (t,x(t),vMt)),(f(t,x(t),u(t)) - f(t,x(t),v))) <0, VveU(t). (4.17) 

Proof. Denote 

F(t,u) = ^t) T \W(t)(f(t,x(t),u(t))-f(t,x(t),u)) 

+H x {t, x(t),u{t),^(t)) - H x (t, x(t),u, ^(t)) 
G(t,u) = $(t)- 1 (f(t,x(t),u)-f(t,x(t),u(t))), 

(t, u) e [0, T] x 17. 

Then by Theorem 4.1, for any u(-) G Z7 a d, we have 



[ dt [ (F(t,u{t)),G(s,u(s))) ds < 0. 
Jo Jo 



Let 



«(■) 









/ F(t,u(tj) \ < 




F( S)U (s))| 2 


ds = 


in*.«(*))| 2 * 


V 


G(s,u(s)) J 




V G(t,«(t)) / , 



i r 

t G [0,T) lim - / 

1 a->0+ a J t 

Then has Lebesgue measure T. Let /3 G E u (.y For a G (0,T — (3), define 

«"(*) 



u(t), if t#\p,P + a], 
u(t), if te [/8,/3 + a]. 



(4.18) 



Then, it a (.) e C/ ad and 

r/3+a 

it 

'/J 

It is easy to see that under assumptions (SI) — (S3), F(-, •), G(-, •) are uniformly bounded. Thus 



rP+a ft pT ft 

/ dt (F(t,u{t)),G(s,u{s))) ds= dt (F(t,u a (t)) 7 G{s,u a (s))) ds < 0. (4.19) 
J b Jp Jo Jo 



\F(t, u)\ + \G(t, u)\ < C, VtG[0,T]xC/ 



for some constant C > 0. Consequently, 



< 



9 fP+a ft 

— dt (F(t, u(t)),G(s, u(s))) ds - (F(f3, u(f3)),G(/3, u(/3))) 

a J/3 Jf3 

jLj" +a ^t-(3)F(t,u(t)), f G{s,u{s))ds-G{P,um 



+ 



P+a 



— 2 I (t- P)(F(t, u(t)) - F(0, u(P))) dt, G(P, u{p)) 
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Of fP+ a : rr 

< — (t-p)dt sup G{s,u{s))ds-G{p,u{P)) 

or Jb re(0,0+a] r- fi J 



+2C 



£(/3,/3+a] ''■ P J {3 



-1 f +a {t-pfdt\ h \ l - [ 
a 3 J 1 la J 



= C sup 

r£[/3,/3+a] 



1 



r-/3 

■/3 + a 



a Jf) 

G(s,u(s))ds-G(f3,u(f3)) 



F(t,u(t))-F(P,u(f3)) 



dt 



\a J v F{t ' u{m2 + im u{m2 _ 2 <F(< ' um F(A m(/3))> 1 d< ; 



Let a -> 0+, we get from (4.18) that 

lim — / / u(t)), G(«, u(*))) = (F(J3, u(J3)),G(J3, u(fi))) 

Therefore, combining the above with (4.19), we get 



(F(l3,u(P)),G(0Mm<O. 



That is, for any u(-) € U a d, 



(F(t, u(t)), G(t, u(t))) < 0, a.e. t € [0, T]. 



(4.20) 



(4.21) 



For k = 1, 2, . . ., denote 



T fe = ji G [0,T]|a« G tf(t), s.t. (F(i,i;),G(t,i;)) > i| . 
Then, 7fc is measurable. We claim 7fe has zero measure. Otherwise, for any t G 7fe, 

r fc (t) = j«etr| (F(t,«),G(t,t;)) > i 

is a nonempty closed subset of £/. It is easy to see that T(-) is measurable since (F(t, v), G(t, v)) 
is measurable in t and continuous in v. Thus, by Lemma 4.2, there exists a measurable function 
Uk ■ Tk ->■ Tfe. Define 

' u(i), ift^Tfc, 



Then u k (-) G J7 od and 



u k (t)),G(t, «fc(t))) > -, a.e. * G T fe . 



Contradict to (4.21). Therefore 7fe has zero measure. Consequently, 

oo 

T = {t G [0,T]|3ue t/(t), s.t. >o} = \jT k 



fe=i 
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has zero measure too. That is, for almost all t G [0,T], 

(F(t,v),G(t,v)) < 0, Vwef7(i). (4.22) 
This completes the proof. □ 

It is not necessary to suppose that U is a Polish space in yielding (4.21). However, usually, 
we can not get (4.22) from (4.21) if we only suppose that U is a separable metric space. To see 
this, we introduce the following example. 

Example 1. Let T > and U <Z [Q,T] be a non-measurable set which contains and has no 
any subset of positive measure. Let 

H(t,u) = -u 2 (t-u) 2 , g(t,u)=u 2 , (t,u) G[0,T]xU. 

Then H and g are smooth. Define 

U{t) = \ u G U\H(t,u) = maxH(t,v)\, t e [0,T]. 

veu J 

Then 

' {0} iftgtf, 



U(t) 
Thus, if 



{0, t}, iiteU. 



u(-) € U ad = {v : [0,T] f/|u(-) measurable, v(t) e t/(t), a.e. [0,T]} , 

we musf feaue u(t) = 0, a.e. t G [0,T]. Otherwise, if E = {t\u(t) ^ 0} ftas positive measure, then 
E C [/ '. T/iis contradicts to the assumption that U has no any subset of positive measure 
Therefore, for any u(-) G f7 ad) 

5(t,u(i))<0, a.e.te[0,T], (4.23) 

However, 

\te [0,T]\ max v) > I = U \ {0} 

[ «€!/(*) J 

/ias not zero measure. This means that the following statement does not hold: for almost all 

te[0,T], 

g{t,v)<0, MveU(t). 



5. Sufficient Conditions. Now, we give a sufficient condition for a control being a local 
minimizcr. In addition to (SI) — (S3), we suppose that 
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(S4) There exists a modulus of continuity uj : [0, +00) — » [0, +00), such that 



\f(t, x, u) — f (t, x,u)\ < u){p{u, uj) , 
\f x (t,x,u) - f x (t,x,u)\ < u(p(u,u)), 



and for fc = 0, 1, 2, . . . , n, it holds that 



V (t, x, x, u) e [0, T] x ft™ x R" x U (5.1) 



\fL(t> x > u ) - fxx(t^,U)\ < w(\x-x\+p(u,U)), 

V (t, x, x, u, u) e [0, T]xR"xR"x[/x U. 

We note that (S2)— (S4) imply 

|f (t, x, u) — f (t, x, u)\ < L\x — x\ + uj(p(u, u)) , 
\f x (t,x,u) - f x (t,x,u)\ < L\x - x\ +uj(p(u,u)). 

For u(-),u(-) e U a d and a G (0,1], we keep the notations used in Sections 3 and 4. 
notation simplicity, denote 

0(i)=w(p(u(t), «(*))), *e[0,T] 

and x a (-) = x(-),X a (-) = X(-), Y a (-) = Y(-) when a = 0. 
The following lemma gives estimates of X a (-) and F Q (-)- 

Lemma 5.1. Assume (SI) — (S4), u(-),u(-) <E W a( j and a e [0, 1]. T/ien /or any a e [0, 1], 



(5.2) 



For 



(5.3) 



X a {t)\<C ( Q{s)ds, Vze[0,T], 
Jo 



|X a (i)| 2 <C/ 6(s) ds, Va;e[0,T], 
\Y a {t)\<C ( \e(s)] 2 ds, Vte[0,T] 



(5.4) 

(5.5) 
(5.6) 



\Y a (t)-Y(t)\ 



C Q(s)ds)+ Q(s)ds / 9(s) da, V*e[0,T], (5.7) 



< C 

1 ^ Jo ' Jo J Jo 

where and hereafter, C > denotes a constant, which is independent ofu(-), a G [0, 1], and may 
be different in different lines. 

Proof. Let a e [0, 1]. By (S2)— (S4), (3.1) and (3.3), 

\X a {t)\< [ \L\X a (s)\ +e(s)] ds, Vte[0,T]. (5.8) 
Jo L J 

Then, (5.4) follows from Gronwall's inequality While (5.5) follows from (5.4) and Cauchy- 
Schwarz's inequality. 
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ds 



Similarly, by (S2)— (S4), (4.11) and (4.13), 

\Y a (t)\ <C f \\Y a {s)\ + \X a (s)\ 2 + Q(s) \X a (s)\] ds, Vi G [0,T]. 
Then using Gronwall's inequality again, we have 

\r a (t)\ < c ^[\x a ( s )\ 2 + e( s )\x a ( s )\\d s 

< C ds {[e(r)] 2 + e(s)9(T)}dT 
= C f (t - s + 1) fe(a)l 

Jo 1 

That is, (5.6) holds. 

The proof of (5.7) is similar but a little complex. Consider (4.11) and (4.13). We have 

f ds [ dr [ t (f* x (s,x(s) +r((x a (s) - x(s)),u(s))X a (s),X a (s)) d( 
Jo Jo Jo 

-lj\fL(s,x(s),u(s))X(s),X(s)) ds 

' ds [ dr [ r(f^( S ,x(s)+rax a (s)-x(s)),u(s))X a (s),X a (s)) d( 
o Jo Jo 



(5.9) 



C ! \Q(s)] 2 ds, Vt G [0,T]. 



(5.10) 



C ds I dr [ r(f^(s,x(s),u(s))X a (s),X a (s)) d( 
o Jo Jo 

f* ds J dr J r (/^( S , x(s), u(s)) (X a (s) + X(s)) , aY a (s)) d( 

< f ds f dr f TLj(T(a\X a (s)\) \X a (s)\ 2 d( 
Jo Jo Jo 

+C J* ds £ dr J Ta(\X a (s)\ + \X(s)\) \Y a (s)\ d( 

< £u>(\X a (a)\) \X a (s)\ 2 ds + cj* (\X°( 8 )\ + \X(s)\) \Y a (s)\ ds 

< C u(c 6(r)rfr)+^ 9(r)dT 6(r) 2 dr} ds 
(C j 9(r)dr) + j Q(r)dT j 6(s) 



< C 



(5.11) 



Similarly, 



'ds f {f k x {s,x{s)+r{x a {s)-x{s)),u{s)),X a (s)) dr 
o Jo 

f ds [ (f^s,x(s)+r(x a (s)-x(s)),u(s)),X a (s)) dr 
Jo Jo 

- f (f*(s,x(s),u(s)),X(s)) ds+ f (f*(s,x(s),u(s)),X(s)) ds 
Jo Jo 
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f da f dr [ (arf^(s,x(s)+rC(x a (s)~x(s)),u(s))X a (s),X a (s)) dr 
Jo Jo Jo 

- f da I dr [ (aTf^(a,x(a)+rax a (a)-x(a)),u(a))X a (a),X a (a)) dr 
Jo Jo Jo 

+ [ (f*(s,x(s),u(s)),aY a (s)) da- [ (f*(a,x(a),u(a)),aY a (a)) ds 
Jo Jo 

< f oj(\X a (s)\) \X a (s)\ 2 ds + f e(s)\Y a (s)\ds 
Jo Jo 

< C e(r)dr) +6(s) 9(t) 2 dr}ds 
cj(c*^ 6(r)dr)+^ 9(r)dr 9(s)] 2 ds. 



C 



While 



f (f*(a,x(a),u(s)),Y a (a)) ds - f (f*(s,x(s),u(s)),Y(s)) ds 
Jo Jo 

< f L\Y a {s) -Y{s)\ds. 
Jo 

Combining (5.11)— (5.13) with (4.11) and (4.13), we get 

\Y a (t)-Y(t)\ < C f \Y a {s)-Y(s)\ds 
Jo 

){C J 9(r)rfr)+^ 6(r)dr J 6(s) 



(5.12) 



(5.13) 



Then Gronwall's inequality implies (5.7). 



ds. (5.14) 
□ 



Now, we give a sufficient optimality condition in the following: 



Theorem 5.2. Assume (SI)— (S4) hold and u(-) e U ad satisfy (3.4), (3.6), (3.7). Let w(-) be 
the function appeared in (S4). If there exists a (3 > 0, such that for any u(-) € U a d, 

dt 



W(t)(f(t,x(t),u(t)) - f(t,x(t),u(t))) 
+H x {t, x(t), u(t),^(t)) - H x (t, x(t), u(t),^(t)), 
^^-^/(a.i^.iiW) «(*)))) ds 



< 



(p(«(t),0(t))) 



t/ien t/iere exists an e > 0, smc/i that for any 



«(■) e V = | «(■) e W Qd | jf w(p(«(t), u(t))) dt < £ 



In particular, u(-) minimizes J(-) over V. 



dt. 



(5.15) 



(5.16) 
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Proof. The proof of the theorem is very similar to that of (5.7) in Lemma 5.1. By (3.7), 



</°(t, x(t), u(t)),X(t)) + f°(t, x(t),u(t)) - f°(t, x(t), u(t)) 



dt 



= [ \H(t,x(t),u{t)),^(t))-H(t,x(t),u(t)),^(t)) 

Jo L 



dt > 0. 



(5.17) 



Then 



J((l - a)5 U (.) + a5 u (.)) - J(S U (.)) 



f(t,x a (t),u(t)) - /°(t, *(*),«(*)) + a(f°(t,x a (t),u(t)) - f°(t,x a (t),u(t))) 

= a t (f°(t,x(t) + s(x a (t)-x(t)),u(t)),X a (t)) ds 
Jo l Jo 



dt 



+f(t,x a (t),u(t))'f(t,x a (t) 1 u(t)) 



dt 



> af dt f (f°(t,x(t) + s(x a (t)-x(t)),u(t))-f°(t,x(t),u(t)),X a (t)) ds 
Jo Jo 

+a f (f x (t,x(t),u(t)),X a (t)-X(t)) dt 
Jo 

+a f (f (t,x a (t),u(t))-f°(t,x(t),u(t)))dt 
Jo 

-a [ (f (t,x a (t),u(t))-f°(t,x(t),u(t)))dt 
Jo 

= a 2 [ dt j ds [ s(fl x {t,x{t) + sT{x a {t)~x{t)),u{t))X a {t),X a {t)) dr 
Jo Jo Jo 

W [ T (f° x (t,x(t),u(t)),Y a (t)) dt 
Jo 

W{ dt I (f x , (t,x(t) + s(x a (t)-x{t)),u(t)),X a {t)) ds 
Jo Jo 

~a 2 f dt f (f^(t,x(t) + s(x a (t)-x(t)),u(t)),X a (t)) ds, 
Jo Jo 

By (S2)— (S4) and (5.4)— (5.6), 

C dt f ds f s (f° x (t,m + sr(x a (t) - x(t)),u(t))X a (t),X a (t)) dr 
Jo Jo Jo 

(f° x (t,x(t),u(t))X(t),X(t)) dt 



(5.18) 



T dt£ ds jT 1 s ((/£,(*, x(t) + sr(x a (t) - x(t)), «(*)) - fl(t, x{t), u{t)))x a {t),X a {t)) dr 



10 Jo Jo 

+a [ dt f ds f s(f° xx (t,x(t),u(t))(X a (t)+X(t)),Y a (t)) dr 
Jo Jo Jo 

> -C [ dt [ ds [ s 
Jo Jo Jo 

cT „ r t 



> 



u(8ra\X a (t)\) \X a (t)\ 2 + (\X a (t)\ + \X(t)\) \Y a (t)\ 
C lj(c e(s)ds) + J @{s)ds {jj 0(s) 2 ds}dt 



dr 
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-C 



By (S2)— (S4) and (5.7), 



(C ( e(s)ds) + I Q(s)ds 



®{s) 



ds. 



(5.19) 



r (f° x (t,x(t),u(t)),Y a (t)) dt- r (f x (t,x(t),u(t)),Y( t )) dt 

Jo Jo 

> -C [ \Y a (t)-Y(t)\dt 
Jo 



- -C 



C 



6(s) ds") 



9(s) ds 



Q(s) 



ds. 



(5.20) 



On the other hand, it follows from (S2)— (S4) and (5.6)— (5.7) that 

dt [ (f°(t,x(t) + s(x a (t) - x(t)),u(t)),X a (t)) ds 
o Jo 

T dt f (f°(t,x(t) + s(x a (t) - x(t)),u(t)),X a (t)) ds 
Jo 

(f°(t,x(t),u(t)),X(t))dt+ f (f°(t,x(t),u(t)),X(t)) dt 

Jo 

[ dt [ ds [ sa(f xx (t,x(t)+ST(x a (t)~x{t)),u(t))X a (t),X a (t)) dr 
Jo Jo Jo 

-f dt f ds f sa(f x > x (t,x(t) + sT(x a (t)-x(t)),u(t))X a (t),X a (t)) dr 
Jo Jo Jo 

+ f dt f (f°(t,x(t),<t))- f x (t,x(t) 1 u{t)),aY a (t)) ds 
Jo Jo 

-c f e(t) \\x a (t)\ 2 + \Y a (t) 

Jo 1 i 



dt 



> -c / e(t) 



Q(s) 2 ds} 



dt 



> -C 



[ e{t)dt [ 

Jo Jo 



G(s) 



ds. 



(5.21) 



Therefore, combining (5.18)— (5.21) with (5.14), (4.14) and (4.16), we have 
J((l - a)5u{-) + a-K(-)) - J{&u(-)) 



or 



> I (f°(t,x(t),u(t)),Y(t))dt+ [ (f^t,x(t),u(t))-f^t,x(t),u(t)),X(t))dt 
Jo Jo 



+11 (f xx (t,Ht)Mt))x(t),x(t)) dt 



-c 



e(t) 



ds 



u(c J Q{t)dt) + j Q{t)dt 

J dtj^ (W(t)(/(t,x(t),S(t))-/(t,5(i),w(t)))+^(i,x(t),u(t),^)) 
H x (t, «(t),^(t)), ^(t)*^)- 1 ^^, x(s), u(s)) - f(s, x(s), u(«)))) ds 
(c J Q(t)dt)+J e(t)dt G(t) 2 dt 
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> 



p-cu(c [ e{t)dt)-c[ e(t) 



Since 



lim C 

e^O+ 



) (It 



oj(Ce) + e 



0(t) 



dt. 



= 0, 



there exists an e > 0, independent of a e (0, 1] and u(-), such that when 



f 

Jo 



Q(t)dt < £ , 



it holds that 



J((l - a)S a{ .) +a8 u{ . ) ) - J(8 a{ .)) /3 
a 2 ~ 2 

Choosing a = 1 in (5.23), we get (5.16) and finish the proof. 



f [e(t) 

Jo 1 



dt. 



(5.22) 



(5.23) 



□ 
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